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(54) [Title of the Invention] ONCOMING VEHICLE RECOGNITION DEVICE 
(57) [Abstract] 

[Object] To recognize easily an oncoming vehicle from an image where a plurality of 
lights such as streetlamps or headlamps of oncoming vehicles are present. 

[Structure] An oncoming vehicle recognition region is set from the image picked up with 
a TV camera (402), the image in this region is binarized, noise is removed and then the 
bright regions are labeled and the center of gravity and surface area of each bright region 
are calculated (404-410). Then, a pair of bright regions that are assumed to be headlamps 



are taken as light candidates (412). When a bright region is present below the light 
candidate, the oncoming vehicle is recognized by recognizing the light candidate as the 
headlamp of the oncoming vehicle (414). The vehicle width is calculated from the 
spacing of the light candidates of the recognized oncoming vehicle (416). Therefore, 
even when light spot regions other than the headlamps of the oncoming vehicle, such as 
streetlamps are present, the oncoming vehicle can be easily recognized from the bright 
regions created by the light of the headlamps reflected by the road surface and the 
headlamps of the oncoming vehicle. 

[Patent Claims] 

[Claim 1] An oncoming vehicle recognition device comprising: 

image pick-up means for picking up images ahead of a vehicle; 
candidate region extraction means for extracting from the picked up 

images a pair of bright regions with the prescribed spacing in the horizontal direction as 

candidate regions of lights of the oncoming vehicle; and 

oncoming vehicle recognition means for recognizing said candidate 

regions as lights of the oncoming vehicle when a bright region is present below said 

candidate regions. 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] The present invention relates to an oncoming vehicle recognition 
device, and more particularly to an oncoming vehicle recognition device for detecting an 
oncoming vehicle traveling ahead of the own vehicle. 

[0002] 

[Prior Art and Problems Addressed by the Present Invention] Headlamps disposed almost 
at front ends of a vehicle and designed to illuminate the preset region have been provided 
on vehicles to improve forward visibility of drivers, e.g., at night. 

[0003] There are headlamps, in which a boundary section (referred to hereinbelow as a 
cut line) between an illumination region and a non-illumination region obtained when the 
road is illuminated with light is controlled by installing a shade plate for shading the 
illumination light in the headlamp and controlling the movement of the shade plate to 
change the illumination range and illumination direction ahead of the vehicle 
correspondingly to the driving state of the vehicle, such as a vehicle speed and traveling 
direction determined by a steering angle. 

[0004] However, if the cut line of the headlamp is controlled, when a vehicle traveling in 
the same direction (referred to hereinbelow as a vehicle ahead) is present ahead of the 
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own vehicle in the illumination range bounded by the cut line that was thus controlled, 
the driver of the vehicle ahead is dazzled by the glare. 

[0005] Likewise, the recognition of the oncoming vehicle has to be conducted similarly 
to the recognition of the vehicle ahead in order to avoid causing glare to the vehicle 
(referred to hereinbelow as "oncoming vehicle") traveling in the opposite direction ahead 
of the own vehicle. 

[0006] Therefore, when the cut line of the headlamp is controlled, it is necessary to 
recognize the position or direction of the vehicle ahead and the oncoming vehicle in 
order to control the cut line, without causing glare to the vehicle ahead. 
[0007] Devices for recognizing a vehicle ahead are known (see Japanese Patent 
Applications Laid-open No. 62-121599, 62-131837, 63-78300) in which a tail lamp (read 
color) of the vehicle that travels ahead of the own vehicle is detected with am imaging 
unit (color camera) comprising a color CCD or the like and the detected image is 
subjected to image processing to specify the position and direction of the vehicle ahead. 
[0008] However, the elements capable of detecting color cannot be readily used for 
detecting a tail lamp because of a very high cost of the detection element itself. 
Furthermore, because images containing color components are difficult to analyze and 
image processing is complex, a large load is placed on the recognition device, and the 
entire system is difficult to use. Furthermore, because a light of an almost white color 
directly falls from the oncoming vehicle, there appears a difference in color and quantity 
of light. For this reason, the vehicle ahead cannot be easily distinguished from the 
oncoming vehicle. 

[0009] In the recognition of the oncoming vehicle that resolves the above-described 
problem, a light quantity detector such as a photosensor is mounted on the own vehicle 
and the quantity of light of the headlamp of the oncoming vehicle is detected, thereby 
enabling detection and recognition of the oncoming vehicle. 

[0010] However, the reflected light from the own vehicle or light from the streetlamps . 
etc. is sometimes detected and when the oncoming vehicle is recognized by detecting 
only the quantity of light, other light can be erroneously recognized as the light of the 
headlamps of the oncoming vehicle. 

[001 1] With the foregoing in view, it is an object of the present invention to provide an 
oncoming vehicle recognition device capable of easily recognizing the oncoming vehicle 
from the image where a plurality of light beams of headlamps of the oncoming vehicle or 
streetlamps are present. 
[0012] 

[Means to Resolve the problems] In order to attain the above-described object, the 
oncoming vehicle recognition device in accordance with the present invention comprises 
image pick-up means for picking up images ahead of a vehicle, candidate region 
extraction means for extracting from the picked up images a pair of bright regions with 
the prescribed spacing in the horizontal direction as candidate regions of lights of the 
oncoming vehicle, and oncoming vehicle recognition means for recognizing the 
candidate regions as lights of the oncoming vehicle when a bright region is present below 
the candidate regions. 
[0013] 
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[Operation] In the oncoming vehicle recognition device in accordance with the present 
invention, the images ahead of the vehicle are picked up with pick-up means such as a 
TV camera. The usual vehicle is well-known to comprise a pair of left and right 
headlamps in the front section of the vehicle. Furthermore, vehicles in which an auxiliary 
lamp such as a fog lamp is installed close to the headlamp have appeared in recent years. 
Therefore, if the oncoming vehicle is picked up with pick-up means during nighttime, a 
pair of light spots (regions) with the prescribed spacing corresponding to the vehicle 
width in the horizontal direction are formed in the image region in which one oncoming 
vehicle is assumed to be present. Therefore, if a pair of bright images with the prescribed 
spacing corresponding to the vehicle width in the horizontal direction are extracted, the 
pair of bright regions are highly probable to be the lights of headlamps or fog lamps of 
the oncoming vehicle. Accordingly, in the candidate region extraction means, a pair of 
bright regions with the prescribed spacing corresponding to the vehicle width in the 
horizontal direction are extracted as the candidate regions for lights of the oncoming 
vehicle from the picked-up image. 

[0014] Wall surfaces of structures such as buildings with high reflective capacity or 
streetlamps are present in the environment where the vehicle travels, light from those 
lamps and surfaces are formed as light spot regions in the picked-up images. Therefore, if 
a pair of bright regions with the prescribed spacing is simply recognized as lights of the 
oncoming vehicle, then the light spot regions formed by the light of streetlamps or 
reflected light of buildings or the like is sometimes erroneously recognized as the lights 
of the oncoming vehicle. 

[0015] The lights of the vehicle headlamps or fog lamps provide for illumination ahead 
of the vehicle. Furthermore, the lights installation position is well-known to be close to 
the road. Therefore, if the image of the oncoming vehicle is picked up during light 
illumination conducted with the lights, the reflected light from the road surface will be 
picked up. Thus, bright regions are formed in the prescribed positions (road surface) 
below the direct light beam from the lights such as headlamps and fog lamps. In 
accordance with the present invention, the oncoming vehicle recognition means 
recognizes the candidate regions as lights of the oncoming vehicle when a bright region 
is present below the candidate regions. 

[0016] As a result, even if a plurality of light spot regions produced by streetlamps or 
reflection from the buildings are formed in the picked-up image, when a bright region 
formed by the reflected light from the road surface produced by the lights of the 
oncoming vehicle is present, the candidate region of the oncoming vehicle is recognized 
as the lights of the oncoming vehicle and, therefore, the oncoming vehicle can be 
recognized with higher reliability. 

[0017] An embodiment employing the traveling vehicle recognition device in accordance 
with the present invention will be described below in greater detail with reference to the 
appended drawings. The traveling vehicle recognition device 100 of the present 
embodiment employs the present invention in the case of recognizing the other vehicle 
traveling in front of a vehicle 10 from a gradation image obtained with a black-and-white 
TV camera. 
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[0018] As shown in FIG. 1, an engine hood 12 is disposed in the upper surface section of 
a front body of the vehicle 10, and a front bumper 16 is fixed at both end sections in the 
lateral direction of the vehicle in the front end part of a front body 10A. A pair of left and 
right (both ends in the lateral direction of the vehicle) headlamps 18, 20 are disposed in 
the lower part of the front body 10A above the front bumper 16. 
[0019] A windshield glass 14 is provided in the vicinity of the rear end section of the 
engine hood, and a room mirror 15 is provided above the windshield glass 14 and inside 
the vehicle 10. A TV camera 22 for picking up images in front of the vehicle and 
connected to an image processing unit 48 (FIG. 4) is disposed in the vicinity of the room 
mirror 15. The installation position of the TV camera 22 is selected close to the viewing 
position of the driver (the so-called eye point) so as to facilitate accurate recognition of 
the road shape in front of the vehicle and to provide for better matching with the visual 
sensation of the driver. 

[0020] A speedometer (not shown in the figures) is installed inside the vehicle 10. A 
vehicle speed sensor 66 for detecting the speed V of the vehicle 10 is mounted on the 
cable (nor shown in the figure) of the speedometer (not shown in the figure). 
[0021] As shown in FIG. 2 and FIG. 3, the headlamp 18 is a projection- type headlamp 
and comprises a convex lens 30, a bulb 32, and a lamp housing 34. The lamp housing 34 
is fixed horizontally to a frame (not shown in the figure) of the vehicle 10. The convex 
lens 30 is fixed in one opening of the lamp housing, and the bulb 32 is fixed via a socket 
36 in the other opening so that the light emission point is positioned on an optical axis L 
(central axis of the convex lens 30) of the convex lens 30. 

[0022] The bulb side inside the bulb housing 34 serves as a reflector 38 with an elliptical 
reflecting surface. The emitted light of the bulb 38 that is reflected by the reflector 38 is 
converged between the convex lens 30 and the bulb 32. Actuators 40, 42 are installed in 
the vicinity of the convergence point. The light of the bulb 32 that was reflected and 
converged by the reflector 38 is shaded by shading cams 40 A, 42 A of the actuators 40, 
42 and the other light is emitted from the convex lens 30. 

[0023] The actuator 40 is composed of the shade cam 40 A, gears 40B, 40C, and a motor 
40D, and the actuator 42 is composed of the shade cam 42A, gears 42B, 42C, and a 
motor 42D. The shade cams 40A, 42A are rotatably supported on a rotation shaft 44 
fixed to the lamp housing 34, and the gear 40B is fixed to the shade cam 40A. A gear 
40C fixedly attached to the motor 40D is engaged with the gear 40B. The motor 40C is 
connected to a control unit 50. The shade cam 40A has a cam shape such that the distance 
from the rotation shaft 44 to the outer periphery thereof changes continuously. The shade 
cam 40A rotates inside the bulb housing 34 in response to the signals from the control 
unit 50, thereby changing the position where the light of the bulb 32 is split into the 
transmitted light and shaded light in the vertical direction. Similarly, the shade cam 42A 
is rotatably supported on the rotation shaft 44 fixed to the lamp housing 34, and the gear 
42B is fixed to the shade cam 42A. A gear 40C fixedly attached to the motor 42D is 
engaged with the gear 42B. The motor 42C is connected to a control unit 50.- 
[0024] Therefore, the position above the shade cams 40A, 42A appears to be located on 
the road and serve as a cut line, which is a boundary between bright and dark zones in the 
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light distribution in front of the vehicle. Thus, as shown in FIG. 16, the shade cam 40 A 
forms a cut line 70, and the shade cam 42 A forms a cut line 72. When the shade cam 40 A 
rotates, the cut line 70 shifts parallel to itself from a position corresponding to the 
lowermost level in the upper part (position of the cut line 70 shown in FIG. 16; it is 
identical to the bright zone limit position in the so-called high beam mode or positioned 
therebelow) to the position corresponding to the uppermost level (position of the virtual 
line in FIG. 16, that is, the bright zone limit position in the so-called low beam mode). 
Similarly, the cut line 72 shifts parallel to itself from the uppermost position (position of 
the cut line 72 in FIG. 16) to the position to the lowermost position (position of the 
virtual line in FIG. 16). 

[0025] The headlamp 20 comprises actuators 41, 43 (FIG. 4). Because the configuration 
of the headlamp 20 is identical to that of the headlamp 18, detailed explanation thereof is 
herein omitted. 

[0026] As shown in FIG. 4, the control unit 50 comprises a read only memory (ROM) 52, 
a random access memory (RAM) 54, a central processing unit (CPU) 56, an input port 
58, an output port 60, and a bus 62 such as a data bus or control bus connecting the 
above-described components. The ROM 52 stores the below-described map and control 
program. 

[0027] The vehicle speed sensor 66 and image processing unit 48 are connected to the 
input port. The actuators 40, 42 of the headlamp 18 and the actuators 41, 42 of the 
headlamp 20 are connected via the driver 64 to the output port 60. The output port 60 is 
also connected to the image processing unit 48. 

[0028] As described hereinbelow, the image processing unit 48 conducts image 
processing of images picked up with the TV camera 22 based on the signals inputted 
from the TV camera 22 and control unit 50. 

[0029] The road shape comprises the shape of the pavement, for example, the shape of 
the road corresponding to one lane formed by a center line or curbstones. 
[0030] The processing of recognizing a vehicle 1 1 ahead and conducting cruise control, 
such as constant-speed traveling by image processing during daytime, which is a base 
processing in the present embodiment, will be explained below with reference to the 
vehicle recognition travel control routine shown in FIG. 6. The position of each pixel on 
the image formed by the image signals is specified by coordinates (X n , Y n ) of a 
coordination system determined by orthogonal X axis and Y axis set on the image. 
[0031] FIG. 5(1) shows an image 120 almost matching the image viewed by the driver 
when a road 122 where the vehicle 10 travels is picked up with the TV camera 22. The 
road 122 comprises white lines 124 on both sides of the lane where the vehicle 10 travels. 
The vehicle 1 1 ahead is recognized by the image 120. 

[0032] If an image signal of the image 120 is inputted into the image processing unit 48, 
image processing is started, a white line candidate point extraction processing and linear 
approximation processing are successively conducted, the traveling lane of the vehicle 1 0 
is detected, and then a vehicle recognition region W P is set (step 710). The processing of 
this step 710 will be described below. 

[0033] In the white line candidate point extraction processing, the candidate points that 
are assumed to be a white line of the lane whether the vehicle 10 travels are extracted. 
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First, a region having the prescribed width y with respect to the position of the white line 
estimation line 126 that was found in the previous cycle is set as a wind region W s (see 
FIG. 5(3). In the case of initial cycle, the set value of the white line estimation line 126 
that was set in advance is read and the wind region W s is set. Furthermore, because the 
probability of the vehicle 1 1 ahead being present in the region above and below the 
image 120 is low, the low limit line 128 and up limit line 130 are provided, and the range 
therebetween serves as the following processing object region. Differentiation is then 
conducted with respect to the brightness in the wind region W s and the peak point 
(maximum point) of the differential value is extracted as the edge point serving as a 
while line candidate point. Thus, the inside of the wind region W s is differentiated in the 
vertical direction (direction of arrow A in FIG. 5(3)) with respect to the brightness from 
the pixel in the lowermost position to the pixel in the uppermost position for all the pixels 
in the horizontal direction, and a peak point of the differential value with large brightness 
fluctuations is extracted as an edge point. The continuation of this edge point is shown by 
a dot line 132 in FIG. 5(3). 

[0034] In the subsequent linear approximation processing, the edge points extracted in 
the white line candidate point extraction processing are linearly approximated by using a 
Hough transformation, and straight lines 134, 136 along the lines that are supposed to be 
white lines are found. The region bounded by the found straight lines 136, 138 and the 
lower limit line 130 is set as a vehicle recognition region W P (see FIG. 5(4)). 
Furthermore, when the road 122 is a curved road, there is a difference in inclination of 
the found straight lines 136, 138, and the region bounded by the lower limit line 130 is 
set as the vehicle recognition region W P (see FIG. 5(2)). 

[0035] After the white line candidate point extraction processing and straight line 
approximation processing have been completed, a horizontal edge detection processing 
and a vertical edge detection processing are successively conducted, the presence of the 
vehicle 1 1 ahead is evaluated in the vehicle recognition region W P and, when the vehicle 
1 1 ahead is present, the distance AV between the vehicles is calculated (step 720). The 
processing of this step 720 will be explained below. 

[0036] In the horizontal edge detection processing, first, horizontal edge points are 
detected by the processing identical to the above-described white line candidate point 
detection processing inside the vehicle recognition region W P . Then, the horizontal edge 
points that were thus detected are integrated in the lateral direction, and a peak point E P 
in the position where the integrated value exceeds the prescribed value is detected (see 
FIG. 5(5)). 

[0037] In the vertical edge detection processing, when there are a plurality of peak points 
E P of the integrated values of horizontal edge points, wind regions W R , W L for detecting 
the vertical lines are so set as to include each of the two ends of the horizontal edge 
points contained in a peak point E P successively from the peak point E P positioned in the 
lower section on the image (point at close distance) (see FIG. 5(6)). The vertical edges 
are detected in the wind regions W R , W L , and the vehicle 1 1 ahead is determined to be 
present when the vertical lines 138R, 138L were detected with good stability. The vehicle 
width is then determined by finding the spacing between the vertical lines 138R, 138L in 
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the lateral direction that were individually detected in the wind regions W R , W L and the 
distance AV between the vehicle 1 1 ahead and the own vehicle 10 is calculated from the 
position of the horizontal edge of the vehicle 1 1 ahead and the vehicle width that was 
thus found. The spacing between the vertical lines 138R, 138L in the lateral direction can 
be calculated from the difference between the representative X coordinates (for example, 
average coordinate value or coordinate value with a high frequency of occurrence) of 
each of the vertical lines 138R, 138L. 

[0038] If the above-described processing is completed, a set travel processing is executed 
(step 730). Step 730 is an example of processing conducted to feedback control the 
presence of the vehicle ahead in the set travel mode such as a constant speed travel 
control or vehicle-to-vehicle distance control. For example, when the distance AV 
between the vehicles, which was found, exceeds the prescribed value, the contact-speed 
travel mode is maintained, and when the distance AV between the vehicles is equal to or 
less than the prescribed value, the constant-speed travel mode is canceled. Furthermore, 
when the distance between the vehicles is controlled for the prescribed value, the vehicle 
speed is controlled so that a constant distance AV between the own vehicle 10 and the 
vehicle 1 1 ahead is maintained. 

[0039] The operation of the present embodiment will be described below. If the driver 
switches on a light switch (not shown in the figure) and turns on the headlamps 1 8, 20, 
the control main routine shown in FIG. 7 is executed for each prescribed interval. In this 
control routine, in step 200 the vehicle ahead is recognized (FIG. 8), in the next step 300 
a gain of the actuator for light distribution control with respect to the vehicle ahead is set 
(FIG. 9), in the next step 400 the oncoming vehicle 1 1 A is recognized (FIG. 1 1), in the 
next step 500 a gain of the actuator for light distribution control with respect to the 
oncoming vehicle is set (FIG. 10), and in the next step 600 headlamps 18, 20 are light 
distribution controlled based on the gains that were thus set. 

[0040] The step 200 will be explained below in greater detail. As shown in FIG. 8, in step 
202 a white line detection wind region is set in the same manner as described above. 
When driving at night, only image up to about 40-50 m in front of the vehicle 10 can be 
detected, and detecting the images at a distance of above 60 m ahead of the vehicle 10 
becomes unnecessary. For this reason, in the present embodiment, because the white line 
detection wind region is determined for the region up to 60 m ahead of the vehicle 
10, a white line detection wind region obtained by subtracting the region above the 
prescribed horizontal line 140 from the wind region W s is set (see FIG. 12). 
[0041] In the next step 204, approximated lines along the white line are found. Thus, 
edge points present in the white line detection wind region W^, are detected, Hough 
transformation is carried out, and approximated lines 142, 144 along the white line of the 
road 122 that were linearly approximated are found (see FIG. 12; see the above-described 
step 710). In the next step 206, the intersection point P N (X coordinate, X N ) of the 
approximated lines 142, 144 is found and the displacement A (A = X N - Xq) in the 
horizontal direction between the intersection point P N and the intersection point P 0 (X 
coordinate, Xq) relating to a straight road, which is taken as a standard, is found. This 
displacement A corresponds to the curving degree of the road 122. 
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[0042] The speed V of the own vehicle 10 is then read (step 208) and the left and right 
correction widths a R , a L for correcting the position of the approximated lines 
correspondingly to the speed V and curving degree (displacement A) are set (step 210). 
For example, the curving degree of the road is determined as a straight road, a right-curve 
road, or a left-curve road and the correction widths <x R , a L are set correspondingly to each 
curving degree of the road. The straight road, right-curve road, or left-curve road can be 
determined by setting in advance the prescribed thresholds for the displacement A which 
is assumed to correspond to a straight road. 

[0043] In the road that was considered to be a straight road, the curvature radius of the 
road along which the vehicle can turn when it is driven at a high speed is large, and the 
vehicle can be assumed to travels along an almost straight-line road. On the other hand, 
when the vehicle is driven at a low speed, even if the road immediately in front of the 
vehicle is close to an almost straight road, the road with a small curvature radius is 
sometimes farther ahead and sometimes no vehicle ahead is contained in the recognition 
region obtained by the white line approximation up to 60 m ahead. Increasing both 
correction widths <x R , a L when the vehicle is driven at a low speed and decreasing the two 
when the speed is high (see FIG. 19) increases the vehicle recognition region when the 
vehicle is driven at a low speed over that at a high speed and increases the recognition 
region of the vehicle 1 1 ahead (see FIG. 14). 

[0044] Furthermore, in the road that is considered to be curved to the right, the left and 
right regions where the vehicle ahead is present vary correspondingly to the curving 
degree of the road (see FIG. 15). For this reason, the correction values a R f , a L f are 
determined correspondingly to the vehicle speed V (correspondingly to the correction 
quantities shown in FIG. 19) and the left and right gains GL, GR are determined 
correspondingly to the curving degree of the road (displacement A) (see FIG. 20 and 
FIG. 21). The left and right correction widths <x R , a L are set to individual values by 
setting the very last correction width by this correction values and gains. Therefore, when 
the curvature radius in the road curved to the right is small (displacement A is large) and 
the probability of the vehicle 1 1 ahead being present on the right side is high, the right 
correction width ot R becomes large and the left correction width a L becomes small. 
Furthermore, when the curvature radius in the road curved to the right is large 
(displacement A is small), the right correction width a R becomes small and the left 
correction width a L becomes large. 

[0045] In the road that is assumed to be curved to the left, the characteristics are inverted 
with respect to those of the road that is assumed to be curved to the left. Thus, when the 
curvature radius in the road curved to the left is small (displacement A is large) and the 
probability of the vehicle 1 1 ahead being present on the left side is high, the right 
correction width a R becomes small and the left correction width a L becomes large. 
[0046] In the next step 212, the vehicle recognition region W P for recognition processing 
of the vehicle 1 1 ahead is determined by using the lower limit line 130, approximated 
lines 142, 144, and the left and right correction widths a R) a L that were set (see FIG. 13). 
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[0047] As described hereinabove, if the vehicle recognition region W P is determined, the 
routine advances to step 214, the present vehicle ahead is recognition processed, and the 
distance AV between the vehicles is calculated by conducting horizontal edge point 
integration in the vehicle recognition region W P determined in the same manner as in the 
detection processing of the vehicle ahead of step 720 (step 216). 
[0048] Thus, because the recognition region of the vehicle 1 1 ahead is changed 
correspondingly to the curving degree of the road and vehicle speed, the vehicle 
recognition region that will be obtained can reliably contain the range in which the 
probability of the vehicle ahead being present is actually high, and the vehicle ahead can 
be recognized with high probability. 

[0049] In the present embodiment, when the detection of the white line is impossible, the 
vehicle recognition region based on the position of the white line detected in the previous 
cycle is used. 

[0050] Step 300 will be explained below in greater detail. Step 300 is a subroutine for 

setting the gain (rotation quantity of the shade cam) for moving the actuator to a cut line 

position in which no glare is caused to the vehicle 1 1 ahead (see FIG. 9). 

[0051] First, in step 302, the distance AV between the vehicles is read and the routine 

advances to step 304. In step 304, the gains DEG L , DEG R of actuators 40, 42 are 

determined correspondingly to the distance AV between the vehicles and the curving 

degree. 

[0052] The gains DEG L , DEG R of the left and right actuators 40, 42 corresponding to the 
road that is assumed to be a straight road are so determined that the gains increase as the 
distance AV between the vehicles increases, (see FIG. 22). In the present embodiment, 
the relationship between the distance between the vehicles and gain in the case of a 
straight road is stored as a map 1, which is a table, in the ROM 52. 
[0053] Furthermore, when the road was considered to be curved to the right, the gains 
DEG L , DEG R are determined according to the curving degree (displacement A) of the 
road curved to the right. When the curvature radius of the right curve of the road is large, 
the road is considered to be almost straight and the gains DEG L , DEG R of the actuators 
40, 42 corresponding to the distance AV between the vehicles are determined with 
reference to map 1 (FIG. 220. When the curvature radius of the right curve is small, the 
probability of the vehicle ahead being present on the right side is high, light distribution 
(cut line 70) on the right side may be used, the gain DEG R of the actuator 42 is taken as 
the prescribed value, and the gain DEG L of the actuator 40 corresponding to the right cut 
line control is determined to assume a value corresponding to the distance AV between 
the vehicles. Thus, the gain DEG R is the prescribed value, regardless of the distance AV 
between the vehicles, and the gain DEG L increases with the increase in the distance AV 
between he vehicles (see FIG. 3). In the present embodiment, the relationship between 
the distance between the vehicles and the gains in the case of the road curved to the right 
is stored as map 2, which is a table, in the ROM 52. Furthermore, when the distance 
between the vehicles is less than the prescribed value (for example, 70 m), the distance to 
the vehicle 1 1 ahead is small and the effect of glare depending on the distance between 
the vehicles is large. Therefore, the gains DEG L , DEG R are determined in the same 
manner as in the case of a straight road. 
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[0054] Furthermore, when the road was considered to be curved to the left, the settings 
are made based on a characteristic opposite that of the road that was considered to the 
curved to the right. Thus, when the probability of the vehicle 1 1 ahead being present on 
the left side is high, the gain DEG L is taken as the prescribed value, regardless of the 
distance AV between the vehicles, and the gain DEG R is increased following the increase 
in the distance AV between the vehicles. In the present embodiment, this relationship is 
stored as a map 3, which is a table, in the ROM 52. 

[0055] Furthermore, the value of the curving degree representing the straight road, road 
curved to the right, and road curved to the left can be estimated by storing in advance the 
estimation standard values. 

[0056] Thus, in the present embodiment, a vehicle recognition region is set for 
recognizing the vehicle present in the road ahead of the own vehicle from the image 
picked up with the TV camera, the vehicle ahead is recognized by changing this vehicle 
recognition region correspondingly to the vehicle speed and road shape, and the light 
distribution of the headlamp is changed. Therefore, optimum light illumination with the 
headlamps of the own vehicle 10 is conducted, without causing glare to the driver of the 
vehicle 1 1 ahead. 

[0057] The step 400 will be explained below in greater detail (see FIG. 11). If the 
oncoming vehicle recognition sub-routine shown in FIG. 1 1 is executed, the processing 
proceeds to step 402 and the oncoming vehicle recognition region is set. More 
specifically, similarly to setting the recognition region for a vehicle ahead, an oncoming 
vehicle recognition region W P0 for conducting recognition processing of the oncoming 
vehicle 1 1 A is determined (see FIG. 17) correspondingly to the vehicle speed V and 
curving degree of the road (displacement A). Thus, the region on the right side of the 
approximated line 144 is considered as the oncoming vehicle recognition region W P0 and 
the left limit position of the oncoming vehicle recognition region W P0 set by the 
approximated line 144 is corrected. 

[0058] When the road is assumed to be almost straight, the correction width a R0 for 
correcting the position of the approximated line is increased when the vehicle is driven at 
a low speed and decreased when the vehicle is driven at a high speed, in the same manner 
as in the above-described recognition of the vehicle ahead (see FIG. 24). In this case, the 
oncoming vehicle recognition region W P0 when the vehicle is driven at a low speed is 
wider than that obtained when the vehicle is driven at a high speed. 
[0059] Furthermore, when the road is assumed to the curved to the right, a correction 
value a RO f corresponding to the vehicle speed V (FIG. 24) and a gain GR^ corresponding 
to the curving degree of the road (displacement A) are set (see FIG. 25), and the right 
correction width a R0 for correcting the position of the approximation line is finally 
(multiplication) determined based on those correction value a RO f and gain GRq. The 
oncoming vehicle recognition region W P0 for recognition processing of the oncoming 
vehicle 1 1 A is determined by using the correction width a R0 that was thus determined. On 
the other hand, when the road is assumed to be curved to the left, a correction value a R0 ! 
corresponding to the vehicle speed V and a gain GR^ corresponding to the curving degree 
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of the road (displacement A) are set (see FIG. 26), the final correction width a R0 is 
determined based on the correction value a R0 ' and gain GRo, and the oncoming vehicle 
recognition region W P0 is determined. 

[0060] Furthermore, in the characteristics of the gain relating to the road curved to the 
right, the gradient is realized with respect to that of the characteristic relating to the road 
curved to the left. This is because the probability of the oncoming vehicle being present 
on the right side is higher. 

[0061] If the oncoming vehicle recognition region W P0 is determined as described above, 
the routine proceeds to step 404 and the image 120, which is an input image (see FIG. 
18(1)) is binarized. Thus, because the light from the headlamps of the oncoming vehicle 
is a direct light, the quantity of light is comparatively easy to specify. Therefore, 
binarization is conducted by taking the region equal to or higher than the prescribed 
threshold value (for example, a value at 90% of the peak value of the brightness) of the 
image 120 as a bright region (for example data 1) and taking the region below the 
threshold value as a dark region (for example, data 0) ( see FIG. 18(2)). Then, the 
expansion-contraction processing is conducted the prescribed number of times (three 
times in the present embodiment) to remove peaks and valleys (step 406). Thus, the 
contraction processing in which all the boundary pixels are deleted with respect to the 
bright regions and the "skin" layer is removed and the expansion processing in which, 
conversely, the boundary pixels are multiplied in the background direction and the "skin" 
layer is increased are conducted, the weakly bonded regions are separated, and fine peaks 
and valleys present on the boundary section of the bright regions and dark regions are 
removed. 

[0062] In the next step 408, labeling is conducted with respect to each bright region from 
which the aforementioned small peaks and valleys have been removed (see reference 
numbers 1-3) in FIG. 18(3)). Then, in step 410, the surface area and position of the center 
of gravity of pixel units are calculated with respect to each labeled bright region. The 
position of the center of gravity can be calculated from the X coordinate value and Y 
coordinate value of each pixel contained in the bright region, and the surface area can be 
calculated by counting the number of pixels contained in the bright region. In this case, 
as shown in FIG. 18(3), the bright region with the reference number 1 has a value of 
center of gravity (X„ Y x ) and a surface area S,. Similarly, the bright region with the 
reference number 2 has a value of center of gravity (X 2 , Y 2 ) and a surface area S 2 , and the 
bright region with the reference number 3 has a value of center of gravity (X 3 , Y 3 ) and a 
surface area S 3 . 

[0063] Here, the oncoming vehicle 1 1 A usually has a pair of left and right headlamps, 
and the light emitted by the oncoming vehicle 1 1 A toward the own vehicle 10 is formed 
as a pair bright regions with the prescribed spacing corresponding to the vehicle width in 
an almost horizontal direction. Therefore, if the bright regions with the prescribed 
spacing corresponding to the vehicle width in an almost horizontal direction are detected 
from the image 120, this pair of bright regions have a high probability of being the 
headlamps of the oncoming vehicle. Accordingly, in the next step 412, all the pairs of 
bright regions which have almost identical coordinates of centers of gravity and in which 
the distance in X coordinate is equal to or less than the prescribed value corresponding to 
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the spacing between the headlamps of a standard vehicle are detected and taken as 
candidate regions for the headlamps of the oncoming vehicle 1 1 A. In this case, the bright 
region pair A is appropriate (see FIG. 18(3)). 

[0064] Furthermore, the headlamps are usually located in a low position and the light 
from the headlamps that was reflected by a road surface such as street or highway also 
propagates ahead of the vehicle. Therefore, when the oncoming vehicle 1 1 A is present, 
bright images are formed in the prescribed position (road surface) and below the direct 
light (bright region pair) from the headlamps in the image 120. For this reason, if the 
bright image is present below the bright image pair, the presence of the oncoming vehicle 
1 1 A can be recognized with high probability. Furthermore, the formation state of this 
bright region differs according to the state of the road surface. For example, in a paved 
road, the light from a pair of headlamps is scattered by the road surface and one bright 
region is formed (FIG. 18). When the reflection factor of the road surface is high, e.g., 
during the rain, each beam from a pair of headlamps is reflected by the road surface and 
two bright regions are formed on the road surface (see FIG. 30(1)). Therefore, in the next 
step 414, the headlamps of the oncoming vehicle 1 1A are recognized and the oncoming 
vehicle 1 1 A is recognized to be present when there is a bright region pair, of the detected 
candidate regions (bright region pairs) of the oncoming vehicle 1 1 A, to which 1-2 bright 
regions correspond that are below the bright region pair and have the surface area equal 
to or above the prescribed value. Thus, in the case illustrated by FIG. 18, the presence of 
the oncoming vehicle 1 1 A is recognized by recognizing the bright region pair A as the 
headlamps of the oncoming vehicle 1 1 A by the presence of the bright region (reference 
number 3) corresponding to the bright region pair A (bright regions with reference 
numbers 1, 2). Furthermore, in the case of rain or the like, as shown in FIG. 30(2), the 
presence of the oncoming vehicle 1 1 A is recognized by recognizing the bright region pair 
B as the headlamps of the oncoming vehicle 1 1 A by the presence of the bright region 
(reference numbers 6, 7) corresponding to the bright region pair B (bright regions with 
reference numbers 4, 5). 

[0065] If the oncoming vehicle 1 1 A is recognized, in the next step 416, the distance AV 
from the own vehicle to the oncoming vehicle is calculated based on the Y coordinates 
(average values of coordinate values Y l5 Y 2 ) of the bright region pair A that was 
recognized as the oncoming vehicle 1 1 A. Thus, the coordinate values move upward on 
the image 120 as the distance between the vehicles increases, and the ratio thereof is 
proportional to the pick-up magnification of the TV camera 22. Furthermore, the distance 
AV between the vehicles can be also calculated from the ratio of the spacing (difference 
between the coordination values X l5 X 2 ) of the bright region pair A and the distance on 
the X coordinate related to the width (headlamp spacing) of the standard vehicle. 
[0066] The recognition processing of the oncoming vehicle 1 1 A is thus conducted in the 
oncoming vehicle recognition region W P0 determined corresponding to the vehicle speed . 
and curving degree of the road. During this recognition processing, even when a plurality 
of light spots formed by the light from the streetlamp or sources other than the vehicle 
are formed in the image picked up with the TV camera 22, the respective bright regions 
of a pair of headlamps are detected and the oncoming vehicle is recognized by 
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recognizing the headlamps of the oncoming vehicle when there are bright regions, of the 
aforementioned bright regions, in the reflection zone of the road surface present 
therebelow. Thus, in the present embodiment, only the bright regions that are highly 
probable to represent the oncoming vehicle can be extracted and the oncoming vehicle 
can be recognized with higher reliability. 

[0067] The step 500 will be explained below in greater detail. Step 500 is a sub-routine 
for setting a gain (rotation quantity of a shade cam) for moving an actuator to the cut line 
positioning which no glare is caused to the oncoming vehicle 1 1 A (see FIG. 10). 
[0068] First, in step 502, the distance AV between the vehicles is read and the routine 
advances to step 504. In step 504, the gains DEG L , DEG R of the actuators 40, 42 are 
determined correspondingly to the distance AV between the vehicles and degree of 
curving. 

[0069] When the road is assumed to be a straight road or a road curved to the right, the 
probability of the oncoming vehicle 1 1 A being present on the right side of the screen is 
high. Therefore, no glare is caused by the movement of the actuator 42 with respect to the 
left cut line. Therefore, the determination of the gains DG L , DG R is so conducted that, as 
shown in FIG. 27, only the gain DG L relating to the actuator 40 relating to the right cut 
line increases with the increase in the distance AV between the vehicles. In the present 
embodiment, the relationship between the distance between the vehicles and gain shown 
in FIG. 27 is stored as a map 4, which is a table, in the ROM 52. 

[0070] Furthermore, in the case of the road curved to the left, when the curvature radius 
is small, the contribution to glare is small even if the left cut line 72 is moved. Therefore, 
the gains DG L , DG R are determined as the prescribed values, regardless of the distance 
AV between the vehicles (see FIG. 28). In the present embodiment, the relationship 
between the distance between the vehicles and gain shown in FIG. 28 is stored as a map 
5, which is a table, in the ROM 52. 

[0071] Furthermore, in the case where the curving degree of the road curved to the left is 
small, the gains DG L , DG R are determined as the values corresponding to the distance AV 
between the vehicles (see FIG. 29). In the present embodiment, the relationship between 
the distance between the vehicles and gain shown in FIG. 29 is stored as a map 6, which 
is a table, in the ROM 52. 

[0072] The step 600 will be explained below in greater detail. If the determination of 
gains of actuators 40, 42 relating to the vehicle 1 1 ahead and the oncoming vehicle 1 1 A 
is completed in the above-described manner, in step 516, the smaller of the gains DEG L , 
DG L relating to the actuator 40 and the smaller of the gains DEG R , DG R relating to the 
actuator 42 are selected. The shade cams of the actuators 40, 42 are moved and the 
distribution of light of the headlamp 18 is changed by controlling the actuators 
corresponding to the gains of the actuators 40, 42 that were thus selected. 
[0073] Thus, in the present embodiment, the vehicles present on the road ahead of the 
own vehicle are recognized by further adding the oncoming vehicle recognition region 
for recognizing the oncoming vehicle to the vehicle recognition region for recognizing 
the vehicle ahead. Therefore, the optimum light illumination by the headlamps of the 
own vehicle 10 is conducted without causing glare to the oncoming vehicle. 
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[0074] Furthermore, in the present embodiment the distribution of light ahead of the 
vehicle was controlled with the shade cams, but the light of the headlamps may be also 
shaded with light shading plates or shutters. Furthermore, the distribution of light was 
controlled by shading the light of the headlamp, but the emission optical axis of the 
headlamp may be deflected. 

[0075] Furthermore, in the present embodiment, the case was explained where the 
oncoming vehicle traveled in compliance with the traffic laws according to which the 
oncoming vehicle is present on the right side ahead of the own vehicle, but the present 
invention is not limited to this configuration and can be easily employed with respect to 
the right-side traffic regulations. 

[0076] Furthermore, in the above-described embodiment, a standard recognition region 
can be set even when white line detection is not conduced during image detection, by 
storing data relating to a vehicle traveling on a straight and flat road where lines of the 
prescribed width are provided on both sides of the vehicle as the data for white lines of 
the road that are the initial data. In addition, the recognition region based on the driver's 
settings can be established by storing and selecting a plurality of patterns of the data. 
[0077] Furthermore, in the above-described embodiment, the oncoming vehicle was 
recognized by headlamps of the oncoming vehicle, but the present invention is not 
limited to this configuration and the oncoming vehicle may be also recognized by 
detecting the auxiliary lamps such as fog lamps. 
[0078] 

[Effect of the Invention] As described hereinabove, an oncoming vehicle is recognized 
by recognizing the light of headlamps or fog lamps of the oncoming vehicle and the light 
of the oncoming vehicle from the reflected light from the road created by the 
aforementioned lights. Therefore, even when a plurality of light spots are present in the 
image, the region with a high probability of the lights being the lights of the oncoming 
vehicle can be extracted and the oncoming vehicle can be recognized with good 
probability. 

[Brief Description of the Drawings] 

FIG. 1 is a perspective view as viewed at an angle from the front of the vehicle 
that illustrates the front section of the vehicle used in the present embodiment. 

FIG. 2 is a perspective view illustrating a schematic structure of a headlamp that 
can employ the present invention. 

FIG. 3 is a cross-sectional view illustrating schematic configuration of the 
headlamp (I-I line in FIG. 2). 

FIG. 4 is a block diagram illustrating the schematic configuration of the control 

unit. 

FIG. 5 is an image diagram for explaining the process of recognizing a vehicle 
ahead based on the image signals outputted by the TV camera that picks up images in a 
daytime. 

FIG. 6 is a flowchart illustrating the recognition processing routine of a vehicle 
ahead based on the image signals of the TV camera that picks up images in a daytime. 
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FIG. 7 is a flowchart illustrating the control main routine of the present 
embodiment. 

FIG. 8 is a flowchart illustrating the recognition processing routine of the vehicle 
ahead of the present embodiment. 

FIG. 9 is a flowchart illustrating the gain setting subroutine of the vehicle ahead. 
FIG. 10 is a flowchart illustrating the gain setting subroutine of the oncoming 

vehicle. 

FIG. 1 1 is a flowchart illustrating the oncoming vehicle recognition processing 
routine of the present embodiment. 

FIG. 12 is a diagram illustrating the wind region during white line recognition. 

FIG. 13 is a diagram illustrating a vehicle recognition region. 

FIG. 14 is an image diagram for explaining how the vehicle recognition region is 
changed correspondingly to the vehicle speed. 

FIG. 15 is an image diagram illustrating the correction width and wind region 
corresponding to a curved road of different curvature. 

FIG. 1 6 is an image diagram for explaining the cut line displaced by an actuator. 

FIG. 17 is an image diagram illustrating the oncoming vehicle recognition region 
of the present embodiment. 

FIG. 18 is an image diagram illustrating the process of oncoming vehicle 
recognition of the present embodiment. 

FIG. 19 is a diagram illustrating the relationship between the vehicle speed and 
the correction width (correction value) of the wind region of the present embodiment. 

FIG. 20 is a diagram illustrating the relationship between the curving degree of 
the road curved to the right and a gain that determines the correction width of the wind 
right side. 

FIG. 21 is a diagram illustrating the relationship between the curving degree of 
the road curved to the right and a gain that determines the correction width of the wind 
left side. 

FIG. 22 is a diagram illustrating the relationship between the distance between the 
vehicles and the control gain of the actuator. 

FIG. 23 is a diagram illustrating the relationship between the distance between the 
vehicles and the control gain of the actuator. 

FIG. 24 is a diagram illustrating the relationship between the vehicle speed and 
the correction width (correction value) of the wind region of the present embodiment. 

FIG. 25 is a diagram illustrating the relationship between the curving degree of 
the road curved to the left and a gain that determines the correction width of the wind 
right side. 

FIG. 26 is a diagram illustrating the relationship between the curving degree of 
the road curved to the right and a gain that determines the correction width of the wind 
left side. 

FIG. 27 is a diagram illustrating the relationship between the distance between the 
vehicles and the control gain of the actuator. 

FIG. 28 is a diagram illustrating the relationship between the distance between the 
vehicles and the control gain of the actuator. 
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FIG. 29 is a diagram illustrating the relationship between the distance between the 
vehicles and the control gain of the actuator. 

FIG. 30 is an image diagram illustrating the bright region produced by the 
headlamp and the picked-up image of the oncoming vehicle during the rain. 
[Keys] 
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